Extending Anchored Learning to Machine Translation Evaluation
نویسنده
چکیده
We compare two methods, Anchored Learning, and a simple new method (Hyperplane Distance), for finding Hard To Learn examples in Machine Learning tasks that use SVMs. These Hard To Learn examples can be corpus errors, or examples which are difficult to predict with the given set of features. The Anchored Learning method is extended to deal with various kernels and SV regression. A number of experiments are conducted on toy data sets and standard ML data sets to characterize their performance. Finally, we present an in-depth application to the task of Machine Translation Evaluation to improve our prior work in this area.
منابع مشابه
SVM Anchored Learning and Model Tampering for Machine Translation Evaluation
We conduct a set of experiments exploring issues of multiple kernels and kernel learning with respect to a previous work on automatic machine translation evaluation that used SVMs. By applying the techniques of model tampering and anchored learning to the learned SVM(s), we demonstrate both their practicality and utility, especially when used for error analysis and to better understand a given ...
متن کاملEvaluation of the Validity and Reliability of a Communicative Scale for Translation Quality Assessment
The present study assessed the construct validity and reliability of a researcher-constructed psycho-motor mechanism scale based on the communicative theory of translation proposed by PACTE (2003). In doing so, the necessary criteria for designing the scale were obtained by a thorough review of related literature on previously constructed scales in error analysis or holistic ones. Moreover, in ...
متن کاملThe Correlation of Machine Translation Evaluation Metrics with Human Judgement on Persian Language
Machine Translation Evaluation Metrics (MTEMs) are the central core of Machine Translation (MT) engines as they are developed based on frequent evaluation. Although MTEMs are widespread today, their validity and quality for many languages is still under question. The aim of this research study was to examine the validity and assess the quality of MTEMs from Lexical Similarity set on machine tra...
متن کاملEvaluation of the Validity and Reliability of a Communicative Scale for Translation Quality Assessment
The present study assessed the construct validity and reliability of a researcher-constructed psycho-motor mechanism scale based on the communicative theory of translation proposed by PACTE (2003). In doing so, the necessary criteria for designing the scale were obtained by a thorough review of related literature on previously constructed scales in error analysis or holistic ones. Moreover, in ...
متن کاملEvaluation of the Validity and Reliability of a Communicative Scale for Translation Quality Assessment
The present study assessed the construct validity and reliability of a researcher-constructed psycho-motor mechanism scale based on the communicative theory of translation proposed by PACTE (2003). In doing so, the necessary criteria for designing the scale were obtained by a thorough review of related literature on previously constructed scales in error analysis or holistic ones. Moreover, in ...
متن کامل